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Reducing work fluctuation and dissipation in heat engines or, more generally, information heat 
engines that perform feedback control is vital to maximize their efficiency. The same problem 
arises when we attempt to maximize the efficiency of a given thermodynamic task that undergoes 
nonequilibrium processes for arbitrary initial and final states. We find that the most general trade-off 
relation between work fluctuation and dissipation applicable to arbitrary nonequilibrium processes is 
bounded from below by the information distance characterizing how far the system is from thermal 
equilibrium. The minimum amount of dissipation is found to be given in terms of the relative 
entropy and the Renyi divergence, both of which quantify the information distance between the 
state of the system and the canonical distribution. We give an explicit protocol that achieves the 
fundamental lower bound of the trade-off relation. 


Recent developments in nonequilibrium statistical me¬ 
chanics enable us to assign physical meanings to nonequi¬ 
librium entropies such as Shannon and von Neumann 
entropies in certain situations [H-Q- The information- 
theoretic analysis of thermodynamics starting from and 
ending at arbitrary nonequilibrium states has been car¬ 
ried out, as in encoding and erasure of information [^-Q. 
An important subset of this category is the information 
heat engines QIMi, since the measurement projects 
the state of the system into the postmeasurement state 
which is usually out of equilibrium. They play a piv¬ 
otal role in controlling small thermodynamic systems 
that operate at the level of thermodynamic fluctuations. 
Viewing biological processes as information processing 
requires us to quantify thermodynamic costs of biolog¬ 
ical sensory adaptation in terms of information-theoretic 
quantities [1^. Suppressing both work fluctuation and 
dissipation as much as possible is vital to heat engines 
and thermodynamic tasks since reducing dissipation al¬ 
lows us to increase the efficiency and reducing work fluc¬ 
tuation makes it possible to supply an exact amount of 
work needed to complete a given task or to extract a 
definite amount of work from the system. 

Considerable efforts have been devoted in search for 
a protocol that minimizes work fluctuation and dissipa¬ 
tion under nonequilibrium situations. Previous studies 
have explored the regime around vanishing work fluctu¬ 
ation by using techniques known as single-shot statisti¬ 
cal mechanics and the regime around vanishing 

dissipation on the basis of the second law of thermody¬ 
namics Si- However, as we prove in the present work, 
these two aims (vanishing work fluctuation and vanishing 
dissipation) are incompatible. We find the trade-off re¬ 
lation between work fluctuation and dissipation with its 
fundamental lower bound set by the information distance 
characterizing the nonequilibriumness of the system. We 
also show that the bounds on dissipation in the single¬ 
shot (vanishing work fluctuation) and reversible (vanish¬ 


ing dissipation) regimes can be smoothly connected via 
the relative entropy (2^ and the Renyi divergence [^ . 
both of which quantify the information distance between 
the nonequilibrium distribution and the canonical distri¬ 
bution. We apply the trade-off relation to information 
heat engines, where the fundamental lower bound of the 
trade-off relation is characterized by the obtained infor¬ 
mation. Numerical simulations on an information heat 
engine based on a single-electron box [illii are per¬ 
formed to verify the trade-off relation. We propose a 
method to construct explicit protocols that achieve the 
lower bound of the trade-off relation. 

Main Results. — We define the extractable work from the 
system as a change of the internal energy that is not ab¬ 
sorbed by the heat bath: VF[r] = E\g{x) — E\.,{y)-\-Q\r\, 
where F denotes the trajectory of the process, (5[r] 
is the heat absorbed by the system, and E\g{x) and 
E\i (y) are the initial and final energies of the eigen¬ 
states, respectively. For nonequilibrium initial and fi¬ 
nal states, the maximum extractable work from the sys¬ 
tem is quantified by the nonequilibrium free-energy dif¬ 
ference 0, i -AE{x,y) = EAg(x) - J^Ai(y), where 
J'ao(x) = E),g(x) -/3“^S'[pini(x)], 5'[q(x)] = -lnq'(x) is 
the Shannon entropy and /3 is the inverse temperature 
of the heat bath. We define dissipation as the difference 
between the maximum extractable work and the actually 
extracted work: 

a[T]=-f3{W[r]+AE{x,y)). (1) 

The first main result of our work is the trade-off rela¬ 
tion between work fluctuation and fluctuation in dissipa¬ 
tion (see Supplementary material for the proof): 

> {{AEf) - {AFf. (2) 

This result implies that the sum of the work fluctuation 
and the fluctuation in dissipation is bounded from below 
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FIG. 1. Trade-off relations, (a) Normalized standard deviation of dissipation cr versus that of work W. The solid line shows 
the lower bound of the trade-off relation ((2|. (b) Average dissipation versus the standard deviation of work. The black solid 
curve shows the lower bound of the trade-off relation m and for arbitrary initial and final states. If da takes the minimum 
value Dao, the lower bound is given by the dashed curve. For a thermalized final state, Adc«(pfln||p™) = 0 and the lower 
bound is given by the green solid curve. Each blue dot is obtained by a numerical simulation of a random quench of a five-level 
system followed by thermalization and isothermal expansion (see Supplementary material for details), (c) The abscissa shows 
the standard deviation of work normalized by that of the fluctuation of the obtained information, and the ordinate shows the 
dissipation normalized by the mutual information between the system and the measuring apparatus. The solid curve shows the 
lower bound of the trade-off relation (nni and m. Blue dots are obtained by a numerical simulation of a Szilard engine in a 
single-electron box [l5|| as illustrated in the inset (see Supplementary material for details). Here n denotes the excess number 
of electrons in the quantum dot, m denotes the outcome of the measurement on n, and e is the measurement error rate which 
is set to be e = 0.02 in the numerical simulation. The relevant two states n = 0 and n = 1 are assumed to be degenerate 
and initially populated with equal probability. Depending on the outcome m of the state measurement, the feedback control 
is performed by lowering the energy level of the m state relative to the other. Finally, the two energy levels are relaxed to its 
initial (equal-energy) state through thermal contact with a heat bath. 


by the fluctuation of the nonequilibrium free-energy dif¬ 
ference (See Fig.[T](a)). If the initial and final states 
are far from equilibrium, the lower bound of ([2]) becomes 
very large. The trade-off relation Q indicates that work 
and dissipation cannot simultaneously take definite val¬ 
ues; if we reduce work fluctuation, the fluctuation in en¬ 
tropy production inevitably increases, and vice versa. 

The second main result is the trade-off relation be¬ 
tween work fluctuation and dissipation. From Q, there 
is a nontrivial relation between a and W if (VF^) — 
{Wf < ((AJ')2) - {ATf. Then, let 

a = (3) 

^((AJ-)2) - {ATf 


Kullback-Leibler divergence (relative entropy) and 


DaiPiniMC) = -7 In 

^ a — 1 


^(Pi„i(a:))“(pi“(x)) 


1 —Q! 


( 6 ) 


is the Renyi divergence [23|. Here da is defined by 


rfa(Pfi„lbAi") =-7 In 

a — 1 


Y.^pUy)r{PxT{y)f- 

V^Y 


( 7 ) 

where the support Y is defined such that da takes the 
smallest value that satisfies 

da {pan I \pIT ) ^ ^oo {pan \ \pIT ) = In max . (8) 

y pai yy) 


where a € [0,1]. In this case, dissipation and work satisfy 
the following inequalities (see Supplementary material for 
the proof): 

(u) > (1 - a){AVa{pini\\plT) + Ada{panMT))^ (4) 
(IF) < -a {AT) - (1 - a) {fa{pan) - J'c(Pini)) • (5) 

Here, AVa = D — Da {Ada = da —D) gives the distance 
between the initial (final) distribution and the canonical 
distribution, D{pini\\pT^) = J2xPini{x) In is the 

^Xq ^ ^ 


The lower bound of (|4]) is given by the black solid curve 
in Fig. [T](b). The asymmetry between Da and da is due 
to the absence of the time-reversed protocol of the ther¬ 
malization process as discussed later. In ([5]), {J-\g) = 
/3“^II(pini||p^“) + F®'i(p^“) is the averaged nonequilib¬ 
rium free-energy, and Ta{pini) = Da{pini\\pTJ') + 
is the a-generalization of the free energy, where 
we denote F'^‘^{q) as the equilibrium free energy whose 
corresponding canonical distribution is equal to the dis¬ 
tribution q. We also define the free energy fa {pan) = 
ld~^da{pan\\pTf') + F®'i(p^“) by using da- We note that 
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< J -► 
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FIG. 2. Protocol achieving the lower bounds of the trade-off relations. We denote {q, H) as a pair of the state q and 
the Hamiltonian H. The transformation (pinijHxg) —>■ (pan^Hx^) that achieves minimum work fluctuation and dissipation 
is illustrated, where a change in the Hamiltonian is shown in a vertical direction and a change in the state is shown in 
a horizontal direction. The explicit protocol consists of five steps, where the extractable work (H4xt} and the dissipated 
work (Hdis) := (o) for each process are shown. Here, iifa(pfin) is a Hamiltonian which satisfies 

(Pfln)“ (p—) . 


the ordering of the Renyi divergence [2^ Hqo > D > Do 
for 1 > a with ([5]) implies AD a > 0 and Ada > 0. 


Explicit protocol and the trade-off relation .— For given 
(pini,i?Ao) and (pfinj^^Ai), we want to find a protocol 
which connects them by reducing both work fluctuation 
and dissipation as much as possible. Although a quasi¬ 
static process makes both work fluctuation and dissipa¬ 
tion vanish, we cannot directly connect (pini,i?Ao) ^ 
(pfinj^^Ai) by the quasi-static process alone because the 
initial and final distributions are out of equilibrium. In¬ 
stead, we prepare two canonical distributions as auxil¬ 
iary intermediate states, and connect them by the quasi¬ 
static process. Then, we connect (pini,i?Ao) with one of 
the canonical distributions by combining a quench pro¬ 
cess followed by thermallzation, and the other canonical 
distribution is connected with (pfi„,i?Ai) by a thermal 
operation and a quench process. The entire protocol is 
illustrated in Fig. [31 and as we show in the Supplemen¬ 
tary material, this protocol is necessary and sufficient to 
achieve the lower bound of ([2]) and 0. 

Now let us discuss the explicit protocol in more detail 
and consider the physical meanings of the quantities that 
appear in 0 and 0. We change the initial distribu¬ 
tion to the canonical distribution /Za{pini) '■= 

^ which is an intermedi¬ 
ate distribution between the initial state and the canoni¬ 
cal distribution for the initial Hamiltonian. This is done 
by quenching the Hamiltonian from H\g to Haipini) and 
extract the work given by (Wext)i = a{{iFxg)-F‘^^{pini)). 
Note that the maximum extractable from from the ini¬ 
tial state is quantified by the nonequilibrium free energy 
(Aao)- The unexpended free energy (1—a) (Axo) is partly 


lost during the thermalization, and the remaining free en¬ 
ergy, which can be extracted by the quasi-static process, 
is given by (1 — a)JA(Pini), as can be seen by noting 
the dissipated work due to the measurement: (Wdis )2 = 
(1 - a){{Dxg) - JA(Pini))- This dissipation 13 (Wdis )2 = 
il-a)ADaiPini\\pT") = ^(Tini||e-^^“(P“V^afe„i)) ap¬ 
pears on the right-hand side of (jl]) , which gives the infor¬ 
mation distance between the initial state and the canon¬ 
ical distribution which we connect during the thermal¬ 
ization process. Thus, the right-hand side of (O is com¬ 
prised of a part of the nonequilibrium free energy a {J-\g) 
which can be extracted by the quench process and the 
free energy (1 — a:)iFaiPini) which remains in the system 
after the thermalization. 

The rest of the protocol is the transformation of the 
canonical distribution to the final state. Because we 
cannot perform time-reversal of the thermalization, we 
invoke a thermal operation [l8| which transforms the 
state of the system by exchanging energy with the heat 
bath. This operation always changes the system closer 
to the thermal equilibrium, and we need to prepare a 
distribution whose “nonequilibriumness” is larger than 
that of the target final state. For this purpose, we 
prepare a localized distribution e“^^“ (Pfin) := 

^ whose support is re¬ 
stricted to Y. The term (1 — a)fa{pfin) is the free en¬ 
ergy which is needed to prepare this localized thermal 
state and a (Aai) is the free energy needed to quench the 
Hamiltonian back to the final one (see ([S]) and Fig. [3]). 
The asymmetry between the transformation of a nonequi¬ 
librium state into a thermalized state and its oppo¬ 
site transformation (i.e., from a thermalized state to a 
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nonequilibrium state) gives rise to the difference between 
Da and da (see (H))). 

As shown in Ref. [l8| . the minimum work cost to cre¬ 
ate pfin from a canonical distribution via the thermal 
operation with the fixed Hamiltonian Haipan) is given 
by with the help of a 

two-level auxiliary system. If we can introduce this aux¬ 
iliary system, the dissipated work for the thermal opera¬ 
tion is found to be {Wdis )4 = (1 - a){J^oo{piin) - 
and the equality condition in (|S]) is achieved (see Sup¬ 
plementary material for details). This condition is also 
achieved if the energy level of the system is dense. The 
lower bound of dl]) with da = D^c is shown by the dashed 
curve in Fig.[T](b). Note that the solid curve jumps (i.e., 
the support Y changes) wherever the line touches the 
dashed curve because we take discrete energy levels. 
Comparison with previous studies. — For a = 1, o 
and dD) are equivalent to the second law of thermody¬ 
namics for arbitrary initial and final states: (cr) > 0 
and (W) < — (AJ^). Since the canonical distribution 
e-^^“(Pi“)/Za(pini) is equal to the initial state for a = 1 
(the same relation holds for the final state), we do not 
need thermalization and the thermal operation to achieve 
the lower bound of the trade-off relations. Then, dissipa¬ 
tion does not occur and we can extract the maximum av¬ 
erage work from the system (see also Fig. [S]). For a = 0, 
dS]) takes the form (IT) < Jq)(pim) — foiPfin), which re¬ 
produce the single-shot results given in Refs. [13113. 
Here, J'o(Pini) = exp(-/3FlAo ( 2 :))] is equal 

to the equilibrium local free energy whose support X is 
the same as the initial state. By raising the initially unoc¬ 
cupied energy levels, this amount of free energy remains 
after the thermalization. 

For a general a, the trade-off relation gives the mini¬ 
mum amount of work fluctuation and dissipation in the 
intermediate regime. Comparing m and we find 
that the distribution of the extractable work is broad¬ 
ened (meaning larger work fluctuation) if we want to in¬ 
crease the average value of work, and vice versa. Thus, 
the trade-off relation gives the best combinations of the 
“quality of work” and the average amount of extractable 
work. For equilibrium initial and final states, we can 
directly connect them by the quasi-static process and 
the lower bound of the trade-off relation (solid curve) 
in Fig. [T] (b) shrinks to a single point at the origin, i.e., 
work fluctuation and dissipation can both vanish. 
Applieations to information heat engines. — The informa¬ 
tion heat engines utilize the information obtained by the 
measurement to extract work from the system. For sim¬ 
plicity, we consider a classical system and assume that the 
premeasurement state p^{x) is given by a canonical dis¬ 
tribution. Then, dissipation is defined as the difference 
between the maximum amount of extractable work [l3 
and the actually extracted work tT‘^[F]: 

CT[r] = -/3(IT^[F] + AA^)+/^^(a;,a), (9) 


and I^^{x,a) = \np^^{x,a) — \n{p^{x)p^{a)) is the 
(unaveraged) classical mutual information between the 
system (S) and the measurement apparatus (M) [i^ . 
Here, p^^{x,a) is the joint probability distribution 
of SM for the postmeasurement state, p^{x) = 

and “)■ trade¬ 

off relation ([4]) takes the following form (see also Fig. [T] 

(c)): 

(a)>(l-a)(/^^-/f^), (10) 

I3{W) <a{l^^) + {l-a)I^^-f3AF^, (11) 

where a is defined by 


a = 


^((/SM)2^ - {iSMf 


( 12 ) 


and = ^lnX(a:,a(P‘®“(2;,a))“(P‘®(a:)p“(a))^ “ 

is the Renyi generalization of the mutual information. 
If we extract the maximum amount of work from the 
system for each measurement outcome, we can extract 
IT'^[r] = —AF^+fj~^I{x,a) from the system, with finite 
work fluctuations. On the other hand, if we discard the 
measurement outcome, we can extract a definite amount 
of work lF'^[r] = —AF^ from the system with large dis¬ 
sipation. This means that (fTOl) and IT^ show a trade-off 
relation between work fluctuation and dissipation due to 
the fluctuation in the obtained information. 

Possible experimental test of the trade-off relations .— 
The proposed trade-off relations can be tested by using 
the single electron box, which was used to realize a Szi¬ 
lard engine [illii. Suppose that we prepare degenerate 
states of a two-level system and perform measurement 
to distinguish the state of the system which is initially 
distributed with equal probabilities P{n = 0) = P{n = 
1) = 1/2, where n labels the state of the system. Let 
the measurement error rate be e and the joint probabil¬ 
ity distribution of the system being n and the measure¬ 
ment outcome being m be given by P(n,m) = (1 — e)/2 
for m = n and P(n,m) = e/2 for m n. A feedback 
control is implemented by lowering the energy level of 
the state n = m and let the energy-level return to the 
degeneracy point (see the inset of Fig. [T] (c)). By track¬ 
ing the state of the system during this feedback, we can 
measure the extracted work for each run of the experi¬ 
ment, and calculate work fluctuation and dissipation. If 
we change the feedback protocol, e.g., by changing the de¬ 
gree of the energy-level shift, we obtain a different exper¬ 
imental data set of work fluctuation and dissipation. By 

plotting |3^J (1F2) - (IT)V((/^^)2) - (iSMf against 
(a ) / as shown in Fig.[I](c), we can test the trade¬ 

off relation between work fluctuation and dissipation in 
information heat engines. The results of numerical simu¬ 
lations of a Szilard engine in a single-electron box using a 
master equation described in Ref. [15| are shown as dots 
in Fig. [T](c). 
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Summary. — We have found a set of fundamental trade¬ 
off relations between work fluctuation and dissipation for 
nonequilibrium initial and final states. We can reproduce 
single-shot results in the limit of vanishing work fluctua¬ 
tion and thermodynamically reversible results (the lower 
bound of the conventional second law) in the limit of 
vanishing dissipation. These two limits are smoothly con¬ 
nected and the minimum dissipation along this boundary 
is characterized by the information distance between the 
state of the system and the canonical distribution. This 
result gives the fundamental bound on both work fluc¬ 
tuation and dissipation starting from and/or ending at 
nonequilibrium states. An application of the trade-off 
relation to information heat engines is discussed, includ¬ 


ing numerical simulations which vindicate the obtained 
trade-off relation. 
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Proof of the first main resuit 

To show the first main result in Eq. (2) of the main text 

^ (H/2) _ + r V(^") - > V (13) 

we first calculate the variance oi a + fiW. By using Eq. (1) in the main text 

a[r] = -f]{W[T]+AT{x,y)), (14) 

we obtain 

_ (^wf) + (^ 2 ^ _ ^^^2 ^ 2/3((aW) - (a) {W)) = {{AFf) - {AFf . (15) 

Next, we consider the property of the variance-covariance matrix defined by 

% = ((W-(W))(A,-(A,))). (16) 

The eigenvalues of Vij are positive semi-definite and thus the determinant of V)j is nonnegative. By taking Xi = fiW 
and X 2 = (T, and from Det[14ij] > 0, we obtain 

{{W^) - - {af) > {{aW) - (a) {W))\ (17) 

Taking the square root of dm, we obtain 

> {aW) - (a) {W ). (18) 

Note that the above inequality holds trivially for {aW) — {a) (W) < 0. Combining (IT5|) and (fT51) . we obtain 

(^v/(W2)-(W)VrV('"')-(^)') > ((A.A)2) - (19) 

By taking the square root of either side of m, we obtain the trade-off relation m- 

The equality condition in (1131) is satisfied if and only if one of the eigenvalues of the matrix Vij is zero, i.e., if and 
only if there exist some constants a and b such that the variance of aa — bfiW vanishes. Without the loss of generality, 
we can take a > 0. 


Proof of the second main result for an equilibrium final state 


We first assume Pfin(2/) = and prove the second main result. We discuss a more general case in Sec. „ From 

the assumption, Eq. da is given by 


a[r] = -/3W[r] - + Fx,{x) 

= -pWiT] - PAF^^ + In 

PxTix) 


( 20 ) 
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where AF^'^ = is the equilibrium free-energy difference, and the trade-off relation (|13|) takes 

the form 


\J {w^) - {wf + r ^ - {H,)- 


( 21 ) 


Detailed fluctuation theorem 

We use the detailed fluctuation theorem which relates the ratio of the path probabilities and the total entropy 
production to prove the main results: 


( 22 ) 

where F and F^^ denote the trajectories of the forward and backward (time-reversed) processes, and P[F] and P[Fi^] 
are the corresponding path probability distributions. Here, 

a[F] = As[F] - PQ[T] (23) 

is the total entropy production, where As[F] = lnpini(a:) — lnpf}n( 2 /) is a change in the Shannon entropy of the system. 
By using the definition of the nonequilibrium free energy, the total entropy production ((23ll is equal to Eq. m- 
Note that Eq. (l2^ can be derived classically [26,27] and quantum-mechanically [27-30] for general settings (e.g., in 
the Hamiltonian dynamics and the stochastic dynamics). The following argument can also be applied to quantum 
systems if the initial density matrix of the system is diagonal in the initial energy eigenbasis. 



Equality condition of the inequality (1211) 


Combining the detailed fluctuation theorem (|2^ and Eq. dini), we have 


aCT[F] - bl3W[T] = &/?AF®'i + ia + b) In - 5In 

^ ^ ^ ^ ^ ^ P[Ft] pr„"(x) 

We set the condition 

aCT[F] - bpW[r] = bl3AF‘^^ + c 

to make the variance of atr — b/3W vanish, where c is a constant. Then, Eqs. (l24|) and (l25)l lead to 


P[^] I Pinijx) 
P[Ft] [pTJ^ix) 


-b 

a+b 


= exp( 


a -I- 6 


(24) 


(25) 


(26) 


The normalization of the backward probability distribution, i.e., X)rcombined with the relation P[F] = 
P[F|a;]pini(a:), fixes the constant c: 




(27) 


where P[Fja:] is the conditional forward probability conditioned on x and X)r/x introducing the Renyi 

divergence, the constant c takes the form 

^ = -(l-a)^a(Pi„ilKr)- ( 28 ) 

where a = a/{a + b). Using Eq. (l27l) . a and W take the following forms: 

Cr[F] = (1 - a) (T>Ao(x) - P>n(PinijjpZ')) , 

PW[T] = -pAF^^ + aVx,{x) + (1 - a)P,(pini|Kr)^ 


(29) 

(30) 
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where 'D\^{x) = liipini(x) — lnp^“(x). Note that J-\o{x) = + 'D\g{x). In particular, the first and the second 

terms on the left-hand side of (1?^ are given by 

^{a^) - {af = r'|l - «Iv/((-^a„) 2) - (^Ao)^ (31) 

^ l^W^) _ l^wf = ( 32 ) 

We conclude that the equality condition in (1^ is satisfied if and only if Eqs. (1^ and (1501) hold and a takes the value 
in a range 0 < a < 1. 


Proof of the second main result 


Let us derive the second main result ((4) in the main text) for the case of pgn = Pa™- 


(ct) > (1 - a)(i4(pini|bAr) - ^«(Pini|bAr))> 


where the work fluctuation is assumed to be fixed (Eq. (3) in the main text) : 


(33) 


where a € [0,1] is a parameter. We start by combining (lOTl) and (IMl) and obtain 

\/(^^) - > (1 - a)^{V^)-{vf. 

Next, we expand the integral fluctuation theorem 

{0 = E^’lrl^ = i 


(34) 


(35) 


(36) 


around CT[r] = tTQ,[r] that 


achieves 


the lower bound of (l35l) : 

O-aP] = (1 - a) {T^Xoix) - Dc^ipiniWpTJ')) ■ 


From Eq. (I36L we obtain 

r 

r 

Here, 


p„[r] = p[r] 


Pini{x) 


1—a 

g(l-a)r>,,(pini|bro") 


(37) 


(38) 


(39) 


gives the forward probability distribution in which the entropy production is close to CTap]. In fact, PqP] = P[rf] 
indicates that (T[r] = Uab]. Expanding the exponent in Eq. (1381) for small u — (Tq, we have 

0 = ln<Je-('"-'"“)^ 

= In (1 - (cr - aa) + ^(cr - (T^f )„ + O ((cr - (Ja)^) • (40) 

We thus obtain the fluctuation-dissipation theorem near the point cTq,: 

2 (cr - cr„)^ = ((cr - cTaf) ^ -{a- cr„)^ + O ((cr - a^f) . (41) 

Since the variance of cr is minimized if and only if cr[r] = crQ,[r], the average value of cr is also minimized for the same 
condition by using Eq. dm. Combining (|55|) and Eq. m, we obtain the inequality (1551) . 













a =1: thermodynamically reversible protocol 
C h 





T. 


V, 


-► 

state 


-► 

state J 


FIG. 3. Protocols achieving the lower bounds of the trade-off relations for thermalized final states. The abscissa and ordinate 
show the state x and energy of the system, respectively. The horizontal bars show the energy levels (the spectrum) of the 
Hamiltonian and the height of each rectangular box shows the probability distribution of the initial state Pini(a:). We illustrate 
how the spectrum changes according to each protocol. After the change of the spectrum is completed, we attach a heat bath 
and quasi-statically change the Hamiltonian of the system to H\^. For a = 1, we change the Hamiltonian to H{pini), which 
is defined such that the canonical distribution with respect to H{pini) is equal to the initial distribution. Dissipation does not 
occur while the system interacts with a heat bath. For q = 0, we change the Hamiltonian by raising the energy levels to infinity, 
whose populations of the initial state are empty [17]. Note that work fluctuation vanishes during this process. For general a, 
we change the Hamiltonian to H'a(pini) = (1 — a)H\g + aH(pi^i), i.e., we mix the changes of the energy levels of two protocols 
0 = 0 and o = 1 by the ratio a : 1 — o. 


Explicit protocols that achieve the lower bound of the trade-off relations 

Reversible regime (a = 1) 

Let us first consider the case of a = 1. The condition ((^ is given by 

p[r] = p[rt], (42) 

which means that the process is thermodynamically reversible, i.e., the backward protocol exactly brings the final 
state back into the initial state. The explicit protocol consists of two steps: (1) Change the Hamiltonian from Hx^ to 
H(j>ini) while keeping the probability distribution Pini(a:) fixed. The new Hamiltonian iL(pini) is chosen such that the 
canonical distribution with respect to iL(pini) is equal to pini{x). (2) We change the Hamiltonian from Lf(pini) to H\^ 
slowly (quasi-static isothermal process). Since the time-reversal of these protocols (1) and (2) brings the final state 
PT''{y) back to the initial state pini(a;), the condition is satisfied. During the protocol (1), we change the energy 
levels of the system, which leads to a nonzero work fluctuation. 


Single-shot regime (q = 0) 

Next, let us consider the case of a = 0. The condition ((^51) is given by 

prpti _ prpi PAo „£’o(pini||pxp°) 

^ ^ ^ ^ Piniix) 

= p[r\x]pi^;-^{x), (43) 

where we introduce a conditional forward probability distribution P[r|a;] = P[r]/pini(a;), and a local canonical dis¬ 
tribution (x) = exp{—l3Exg{x) + PPxo + Do(pini|bA“)) which has the same support X = {x\pi^i{x) ^ 0} as 

the initial distribution. Now the condition (H51) means that we should construct a process starting from p^“’^(x) 
which is thermodynamically reversible. Since the protocol Aj starts from a Hamiltonian Hxq , we need to consider the 
following two steps: (1) Change the Hamiltonian from Hx^ to a local Hamiltonian by changing 

the energy levels labeled by a: ^ X to infinity in the initial Hamiltonian Hq. Then, p^“’'^(x) is equal to the canonical 
distribution with respect to (2) Change the Hamiltonian from to Hx^ slowly in contact with the heat bath. 
Since the time reversal of these protocols (1) and (2) brings the final state p“"(y) back to p'^x^’^(x), the condition in 
Eq. (H51) is satisfied. 
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Now let us consider how the initial distribution changes by applying the protocols (1) and (2) described above. 
During the protocol (1), the probability distribution does not change. However, at the beginning of the protocol 
(2), the initial distribution thermalizes to (x) because the change of the Hamiltonian from to is slow. 

Finally, the distribution of the system is given by Note that during the thermalization process, the work 

fluctuation is zero but the dissipation is nonzero. 


Intermediate regime (general a) 

Finally, we consider the case of general a. The condition (1261) is given by 

pjpt] = p[r] ( e(i-«)D.(Piniiipr;) 

\ Pini(3^) / 

= P[r\x]pa{x), (44) 


where 


P<.{x) = (45) 

is the canonical distribution with respect to the Hamiltonian Ha(Pini) = (1 ~ ci)H\g + aH{pini)- Following a similar 
argument for the protocol a = 0, we can show that the explicit protocol is given by the following two steps: (1) Change 
the Hamiltonian of the system from H\g to Ha{pini) by keeping the initial distribution pini{x) fixed; (2) Change the 
Hamiltonian from Ha{pini) to H\g slowly in contact with the heat bath. Due to this interaction with the heat bath, 
the distribution pin, thermalizes to the canonical distribution pa at the beginning of the protocol (2). Note that the 
explicit protocol is given by mixing two protocols a = 0 and a = 1 by the ratio a : 1 — a. See Fig. 2 in the main text 
which describes a change in the energy levels in protocol (1). 

Note that the protocol (1) described above can be thought of as an ordinary adiabatic process if we can turn off the 
interaction between the system and the heat bath during the control of the Hamiltonian. If the heat bath is always 
in contact with the system, we need to quench the Hamiltonian instantaneously. 


The case of a nonequilibrium final state 

In this section, we consider the case in which the final state is out of equilibrium. Recall that the lower bound 
of (I^T|) is satisfied if and only if the variance of aa — (I — a)W is equal to zero, and the constant a takes a value 
between [0,1]. By setting the condition 


aCT[r] - hl3W[T] = bl3AF^^ + c', 


(46) 


we obtain a relation between forward and backward probability distributions: 


exp(c') 


C \ —(1 —a) / \ 1 —a 

Pinijx) \ / pUv) \ 

p—(x) ) \plTiy)) 


(47) 


where c' is a constant which will be determined later. We first identify an explicit condition on path probabilities 
which gives the lower bound of the trade-off relation (4) in the main text by rewriting the above condition (1471) : 

P[r|a;]p„(a;) = P[r1'|y]p'„(j/). (48) 

Here, we use the definition of the canonical distribution p^ with respect to the Hamiltonian given in Eq. (1451) . 
Similarly, we define the canonical distribution p^ with respect to i7a (Pfin)j where 

pUv) = ( 49 ) 

and Haipfin) = (1 —Q:)i7Ai +Q:i7(pfin)- Here, the Hamiltonian i7(pfin) is defined such that the canonical distribution for 
H{pfin) with the inverse temperature [3 is equal to pfin- Note that the constant c' is determined by the normalization 
condition of the distribution (H^ . 
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The condition (|48)) is satisfied if the system Hamiltonian is slowly changed from Ha to -ffa(pfin)- However, we 
should note that we cannot transform the distribution Pa to pan in contact with a heat bath, because we do not have 
a time-reversal protocol of the thermalization process. Due to this asymmetry in time, we consider a modified protocol 
in which the support of the distribution p'aiy) is restricted to y € Y. By invoking the idea of thermo-majorization 
(Ref. [18] in the main text) which is to be explained later, we determine Y in which p'aiv) can be transformed to puniy) 
only by exchanging heat with the heat bath (i.e., vanishing work fluctuation). Then, the normalization condition fixes 
the constant c': 


and 


c' = (1 - a)DaiPini\\pT^) + (1 - a)da(pfinlbAr) (50) 

(1 - a)daiPfin\\plT) = - In E (Pfin(2/))“(Pr(2/))'”“- (51) 

y&Y 


Then, 


P 


f 

Oi 


Q-PHI (pfin) 

ZliPfin) 




(52) 


where (pfin) is obtained by taking the Hamiltonian Ha{pfin) and restricting its support to Y. 

Now let us briefly review thermal operation and thermo-majorization which we use to determine Y. Let be a 
density matrix with no off-diagonal components in the energy eigenbasis of the system Hamiltonian . Then, the 
thermal operation £ is defined by the following map 

£{p^) = YvBp^^ip^ ® (53) 


where is the canonical distribution of the heat bath with respect to the Hamiltonian with the inverse tem¬ 
perature /3, and Tr^ denotes a partial trace over the degrees of freedom of the heat bath. We also require that the 
unitary operator satisfies the energy conservation of the composite system; 

+ H^]=0. (54) 


Since the initial state does not have coherence, we can also think of f as a stochastic map with total energy conservation 
for a classical system. From the total energy conservation, the internal energy change AE of the system is equal to 
the heat Q transfered from the heat bath to the system, i.e., the work is zero during this operation. 

Next, let {i?S“"(2/)} represent the eigenspectrum of the Hamiltonian Ha{pfin)- We arrange the final state puniy) 
according to the following order: 


_ Pfin(yi) _ ^ _ Pfin(P2) _ ^ _ 

Then, we plot a convex curve (Lorenz curve [31]) in the (?/,a;) plane in which each point is given by 


(55) 


(Pfill) ■ 


(Pfin) 


= ((Pfin(?/l), 


2a (pfin) 


),C^PAniyi),Y^ 


2 


2a. 




3 Q-ysi 


'"{Vi 


2a (pfin) 


.(1,1)), 


(56) 

where Za{pf^n) = e“^^“is the partition function with respect to the Hamiltonian iLa(Pfin)- Note that the 

ordering (l5^ ensures that the curve (l56l) is convex. Then, it has been proven in Ref. [18] in the main text that a 
state transformation from p to q is possible by thermal operation (with the system Hamiltonian iLa(pfin)) if and only 
if the curve (g, ) is a subset of the curve (p, )■ 

Now our task is to find a local canonical distribution e“^^“ *'^*‘”V^(^(Pfin) with support Y such that by a thermal 
operation, it can be transformed to pfin. By plotting two curves (pfin, z (p^T* ^ z'^ ^ ^ (p^T* ^ ™ 

Fig. m (a), we conclude that the slope of the latter curve should be larger than that of the former: 


> 


Pfin(yi) 




(57) 
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FIG. 4. (a) Lorenz curve and the definition of the support Y. We plot /Za(p{in)}k and p{yi)}k 

in the {x,y) plane, where the curve p = is represented by the dashed line and p — pa^ is represented by 

the solid curve. The dotted line is an extension of the line connecting two points: (0,0) and (e~^^“ *'^^V^a(Pfln)iPfin(j/i)). 
The support Y is defined as the largest support such that the slope of the line e“^^“ (Pfln) is equal to or larger than 

that of the dotted line. Then, the thermo-majorization criterion tells us that the local equilibrium state e~^^“ (Pfln) 

can be transformed into pun via a thermal operation, (b) The case of introducing an auxiliary system. By introduc¬ 
ing an auxiliary system, the joint probability distribution ® can be transformed into pfln ® p^n if 

the slope of the line e“^^“i^f‘"i/Zc,(pfln) 9 pf is equal to or larger than that of the line connecting two points: (0,0) and 
(e-/3(^?‘“(^i)+^)/(Z4pfl„)Z^),Pfl„(yi)e-'57Z^). 


We choose the largest support of Y that satisfies the condition (l57l) . We denote the eigenenergies Ep^.^{y) and 
E\iiy) corresponding to the Hamiltonians i?(pfin) and 77 ai- We also introduce the partition functions Z(pgn) = 
T^y^^Pi-P^Puniv)) and Zxi = J2y(^^P{-PExAy))- It follows bom pf^niv) = exp{-^Ep^.^{y))/Z{pi^n) that the Renyi 
divergence between the final and canonical distributions is given by 

(a - l)i?„(Mn|br) = = la ji-c ■ (58) 

Using Eq. ([58]), the right-hand side of (|57|) can be expressed as 

( \ l — a 

Pfiniyi) \ 

PlTiyi)) 

= exp [(1 - Q;)(Doo(Pfln|bA“) - DaipfinWpT^))] , (59) 

where 

Doo{p\\q) = In max (60) 

y q{y) 

is the Renyi divergence of order oo. The left-hand side of (l57l) can be expressed as 


Za (Pfin ) 




= exp [(1 - a){da{pfin\\pT^) - Da{pfin\\pT^))] ■ 


Now the condition (1571) to determine Y is rewritten in terms of the Reny divergences as 

exp [(1 - a){dc.{piin\\pTn - ^-(Pfinlbr))] > exp [(1 - a)(Uoo(pfi„|br) " D^PfinWpTn)] ■ 


(61) 


(62) 


We note that this condition can be expressed by using the Lorenz curve as shown in Fig. |4| (a). If the energy level 
^a''"iy) is dense, we can choose Y such that the equality condition of (|62p holds. Also, if we can attach an auxiliary 
system, we can tune the energy level of the total system in such a manner that the equality condition of (1621) holds 
as described in the next subsection. 
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Having established a method to determine we can calculate the functional form of a and W for the boundary 


by combining Eqs. and dsni): 

cr[r] = (1 - a){'D\g{x) - Va - Vx^{y) + da), (63) 

I3W[T] = + (1 - a){Va - da) + a{Vx,{x) - V^M), (64) 

where 'Dx^{y) = \npfin{y) — lnp“"(j/) is the distance between the final state and the canonical distribution. 

Let us now derive the trade-off relation between work fluctuation and dissipation for arbitrary initial and final 
states. We fix the amount of work fluctuation as 

^((aj-)2) _ (AJ-)^ (65) 

where a £ [0,1] is a constant. We use exactly the same method that we use in deriving (l33l) except that (Ta[r] in 
the present case is given by Eq. (ESI- Then, for the fixed work fluctuation (1551) . the bounds on dissipation and the 
average work take the following forms: 

(cr) > (1 - a)iD{pini\\pTJ') - Da{pini\\pT^)) + (1 “ a){da{pfin\\plT) “ (pfin | IPAi")) : (66) 

{W) < -a {AF) - (1 - a)(/a(pfln)(Pfin) - Fa{pf,n)- (67) 


The case of introducing an auxiliary system 


Here, we consider a different setup of a two-level auxiliary system A, whose eigenenergies are given by E^{Q) = 
0, E"^{1) = e. We construct a protocol which gives the equality condition of (1621) in this setup. For simplicity, we 
first consider the case of a = 0. We consider a transition from p“" 0pf to PHn’^ptan ^ thermal operation, where 
p^(0) = 0,p^(l) = 1. Note that the support of the joint distribution p^“ ® pf is restricted to (p, 1). Then, 

doiPfin^ptnWPxT ®pt) = Inpin(l) = “ F"^)- 

If we choose e such that 

L>oo(pfin||p“") = /3(e - F'^) = do(Pfin ®pinl|PAi" <^Pe), 
the lower bound of the trade-off relation (pSl) in the case of a = 0 is given by 

(a) > D{p,ai\\plT) - ^o(PinilKr) + 74oo(pfln||pr) “ Dip^uMT)' (^O) 

Here, we note that the quantity e — E^ is equal to the work cost of creating p^ starting from p^jj. 

Next, let us consider the case of general a. In this case, we consider a transition from exp(—/3i7Q,(pfin))/^a(Pfin)<8ip^ 
to pfin ® pfsTL ^ thermal operation. This operation is possible if e satisfies 

Pfin(pi) 1 


( 68 ) 

(69) 


exp [(1 - a){DaaiPfin\\pTP) “ (Pfin | IPa^) )] = 




(71) 


where = 1 -|- e is the partition function of A (see Fig. |4l (b)). By noting that the initial and final probability 
distributions of the ancillary system are given by pf and ilTfll takes the form 


exp(c') = 


P[T]pf{z) f Pini{x) 


-( 1-0 


H^^PAni^) \PlT(^) 

Using the following expression 

exp(-/3P;g«"(p)) 


Pfin(y) 

.plTiy) 




(72) 


(73) 


the constant c' is determined by 

c' = (1 - a)Da{pini\\pT^) + (1 - a)Daipfin\\pT^) “ lnpi„(l). (74) 

Combining Eqs. (ED and ED, we obtain 

c' = (1 - a)DaiPini\\pT^) + (1 - a)DooiPfin\\pT^)- (75) 

If the energy level of the auxiliary system satisfies Eq. ED, the lower bound of the trade-off relation (I66p is lowered 
and takes the form 

(cr) > (1 - a){D{piai\\pT^) - Da{pini\\pT^)) + (1 “ a) (L>oo (pfin | |PAi") “ ^ {pfin\\plT)) ■ 


(76) 
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Extractable work for each step of the protocol that achieve the lower bound of the trade-off relation 

Here, we calculate the work and dissipation for each step of the explicit protocol. First, let us denote the canonical 
distributions as 


g-/3trc(pi„i) 
-^a (Pini) 

(Pfin) 






where 


^r(Mn) = ^sr“(2/) 

y&Y 


(77) 

(78) 


(79) 


is the local Hamiltonian whose support is restricted to Y and {pan) = 6xp(—(y)) is the corresponding 

partition function. Let us denote (p, H) as the set of the distribution p and the Hamiltonian H. We also denote the 
nonequilibrium free energy as 


p-/3tt 

T{p,H) = F-^ + f3-^D{p\\^), (80) 

where is the equilibrium free energy with respect to the Hamiltonian iJ. The explicit protocol that achieves the 
lower bound of (2), (4) and (5) is given by 

1. Quench process (pi„i,iJAo) (Pini, 77a(Pini))- 

The extractable work during this quench process is given by 


{W), = Y,p,^,ix)iE^„ix)-EPj^^ix)) 

X 

= a^Pini{x){Ex„{x) - Ep,^,{x)) 

X 

= a{Fx,)-aE‘^^{p,^{). (81) 


2. Thermalization process (pini, 77a(Pini)) i7a(Pini))- 

The extractable work vanishes and the dissipation is given by the nonequilibrium free-energy difference: 

(a )2 = .F(pini,i7„(pi„i)) - .F(e-^^“(^’‘”‘V^c.(Pi„i),i7a(Pi„i)) = (1 - a)((^Ao) - -^a) 

= /3-li?(pini||e-^^“(^-V^a(Pini)) = (1 " a) ATI, (pi„i | Ip^^") • 


(82) 


3.a. Quasi-static process i7a(Pini)) ( *" zllpan)’ ’ (Pfin))- 

The extractable work is equal to the equilibrium free-energy difference 


(W)3 = E^^ 


3-ytfa (pini) 


_ 


(Pfi, 


^ ' ^a(pi„i) ) ^ \ Zlip^^) ^ 

= (1 - a)Fa{pini) + ai^®‘’(pi„i) - (1 - a)/a(pfl„) - ai^®‘’(pfin)- 


( 83 ) 


3.b. 


Quench process 


( 


2.1 (Pfi„) 


HX (Pfin)) -S' ( 


21 (Pfi„) 


Ea (Pfin ) ) ■ 


The extractable work and the dissipation both vanish during this process. 
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4. Thermal operation z^ip^nf ’ -^a(Pfin)) (Pfin,^^a(Pfin))- 

The extractable work vanishes and the dissipation is given by the nonequilibrium free-energy difference: 


3-1 




(pfi„ 


) (Pfin) 


(Pfin) 

= (l-a)(/a(Pfin)-(-FAi)) 


-•^(Pfl ni -^ct (Pfin) ) 

(1 - a)l3~^Adaipfin\\plT)- 


(84) 


5. Quench process (pfin,-ffa(pfin)) (Pfin,^Ai)- 
The extractable work is given by 

(W ^)5 = - Em (y)) = -« (-^aQ + aF^^^pf^^). (85) 

y 

By combining the extractable work and the dissipation given above, the lower bounds of (4) and (5) are obtained: 

(ct )2 + (cr )4 = (1 - a)ADa{pini\\pT^) + (1 “ «) (pfin | |Pa“) , ( 86 ) 

(lT)i + ( 11^)3 + ( 1 T )5 = a((J-A„) - (-FaQ) - (1 - a)(/a(pfin) - -Fa(pini)). (87) 

By noting that faiq) > •Foo(d) > Ea{q), extractable work starting from a nonequilibrium state is always smaller 
than the work cost of preparing a nonequilibrium final state starting from equilibrium, as shown in the case of a = 0 
in Ref. [18]. This relation holds for a general a with fixed work fluctuation except for the reversible regime a = 1 
because of the asymmetry of the protocol. 


Detailed description of the numerical simulations 


Numerical simulation in Fig. 1. (b) 


A numerical simulation is done in a five-level system, and we plotted the dissipation versus the work fluctuation 
in Fig. 1. (b) in the main text. We choose the initial distribution as pini(a;) = {0.7,0.2,0.075,0.025,0}. We also 
set the canonical distribution with respect to the initial Hamiltonian Hx^ as p^“(a:) = {0.5,0.3,0.1,0.075,0.025}. 
The numerical simulation is carried out by randomly generating a quenched Hamiltonian idquench- During this 
quenching process, work is put in or extracted from the system, given by W{x) = Ex^{x) — Aquench(a:)- Using this 
expression of work, we can calculate the work fluctuation along this process. After the quench of the Hamiltonian, 
we consider an ideal thermalization process in which the thermalized state is given by the canonical distribution 
Pquench(2^) ^ith respect to the quenched Hamiltonian idquench- The energy dissipated during this process is quantified 
by ^{x) = lnpini(a;) — lnpq“j^^jj(a;). After the thermalization process, we consider an isothermal expansion by changing 
the Hamiltonian from idquench to H \^; then, the work fluctuation and the dissipation vanish during this process. Note 
that this idealized thermalization and isothermal processes are enough to explore the lower bound of the trade-off 
relation for the thermalized final state. We plot the following quantities for each quenched Hamiltonian in Fig. 1. 
(b): 


= ^pi„i(x)(W(x))2 - ^pi,i(x)W(x) , (88) 

X \ X / 

(ct) = y]pi„i(a;)CT(a;). (89) 

X 

In Fig. 1. (b), we choose pfin(p) = {0.6,0.2,0.1,0.075,0.025} and p“"(p) = {0.5,0.2,0.15,0.1,0.05} to calculate 
the lower bound of the trade-off relation for a target final state pen- Note that the support Y in the definition of 
da(pfin||PA“) changes from Y = {0,1} to F = {0,1,2} around a = 0.13 and from Y = {0,1,2} to F = {0,1,2,3} 
around a = 0.81. 
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Numerical simulation in Fig. 1 (c) 


We consider a Szilard engine-like information heat engine in a single electron box in Fig. 1 (c) in the main 
text, following Ref. [15] in the main text (we also follow the parameters of numerical simulation described in the 
supplementary material of Ref. [15] in the main text). We consider a two-leveled system whose initial distribution is 
given by p^{n) = {^, where n = {0,1} labels the state of the system. The internal energy of the system is given 
by E{n) = Ecin — n.g)^, where E^ is the total charging energy, Ug is a control parameter which can tune the energy 
level of the system by changing the gate voltage. The initial and final Hamiltonians are given by setting rig = i. 

We consider a measurement of the system, where the joint probability distribution of the state of the system 
being n and the measurement outcome being m is given by P{n,m) = (1 — e)/2 for m = n and P(n,m) = e/2 for 
m ^ n. Here, we set the error probability as e = 0.02. For example, the postmeasurement state conditioned on the 
measurement outcome m = 0 is given by P{n\m = 0) = {1 — e, e}. We change the control parameter rig depending 
on the measurement outcome. One typical example (for m = 0) is to change rig to riquench = 0.349 instantaneously, 
followed by a slow return to the degeneracy point; 


ng(t) 


'^quench (0.5 riquench) 


log(l -f t) 
iog(i + r)’ 


(90) 


where t is the time and T is the total time needed to complete the feedback control. Note that riquench is determined 
from the condition that the canonical distribution with respect to the Hamiltonian with rig = riquench is equal to the 
distribution of the postmeasurement state. 

The probability distribution during the feedback control is numerically calculated by using the following master 
equation 

= = -ro^i(t)P(n = 0, t) + T,^o{t)P{n = 1, t), 

= -ri^o(i)^(n = 1, t) TFo^i (t)P(n = 0,t), (91) 

where P(n,t) is the probability distribution of the system being n at time t, and ro_>i(t) is the tunneling rate of the 
single-electron box at time t for the transition 0^1 using the expression given in Ref. [15] in the main text. The 
work is determined by the energy change of the system by changing the external parameter ng(t): 


W{n,t) = Et{n) - Pt+At(n), 


(92) 


where Et(n) = Ec(n — ng{t))‘^ is the energy of the system at time t. The average extractable work from the system 
and work fluctuation are given by 


(w^) = E W (n, iAt)P{n, iAt), 

i,n 


_ l^wf = E 

i 


E ^ iAt)^P{n, iAt) 



W(n, iAt)P{n, iAt) 


(93) 

(94) 


where At is the discretized time step. Different types of feedback protocols are obtained by changing riquench, T and 
the functional form of rig(t). For each feedback protocol, we calculate the dissipation and the work fluctuation, and 
plot them in Fig. 1 (c). 
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